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PREFACE 

The  linear- logarithmic  programming  method  documented 
in  this  Memorandum  was  developed  to  handle  chemical 
equilibrium  problems  in  computer  modeling.  It  forms  a 
part  of  the  continuing  program  of  research  at  The  RAND 
Corporation  in  medicine  and  biology  Ll,2J,  and  was  moti¬ 
vated  primarily  in  conjunction  with  the  work  of  J.  C. 
DeHaven  and  E.  C.  DeLand  in  modeling  biological  and  physio¬ 
logical  processes. 

The  particular  method  may  also  be  useful  in  other 
modeling  applications  in  which  linear  and  logarithmic 
terms  are  present. 
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SUMMARY 


In  this  Memorandum  Is  developed  the  algebraic  solu¬ 
tion  of  the  linear- logarithmic  programming  problem,  derived 
by  means  of  Lagrange  multipliers.  Then,  two  numerical 
methods  for  solving  the  problem  are  given,  one  of  which 
is  a  generalization  of  a  method  previously  used  [3J  to 
solve  the  chemical  equilibrium  problem.  Convergence  has 
not  been  proven  for  either  of  these  methods;  however,  a 
number  of  large  chemical  equilibrium  problems  have  been 
solved  using  one  or  both  of  the  methods. 
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THE  LINEAR-LOGARITHMIC  PROGRAMMING  PROBLEM 


We  wish  to  consider  the  problem  of  minimizing 
N 

0  *  y  x,(c.  +  dj  log  x j )  (1) 

J-l 

while  satisfying  the  constraints 


i 

j*l 


a.,  x.  -  b.  =  0  ;  i  =  1,2,3, ...,M  (2) 

lj  J  l 


where  a^j>  c^ ,  d^ ,  are  constants  and  x^  are  unknowns. 

If  all  dj  are  zero,  we  have  a  linear  programming 
problem--the  case  that  we  consider  here  is  when  none  of 
the  dj  are  zero.  Using  the  Lagrange  multiplier  method 


N 


of  solving  the  problem,  we  set 

M 
L 

i-1  j=l 

A  local  extremum  is  obtained  if 


0  +  Y  n  (  /  a.  .  x.  -  b.) . 

T  L  i  v  L  lj  j  l 


j  “  1,2,3 


,N 


or 

M 

cj  +  dj  log  xj  +  dj  +  2,  17 i  aij  "  0;  (3) 

i-1 

j  -  1,2,3,.. .,N. 
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Solving  (3)  we  have 


log  Xj 


■CJ  -  dj  •  4  "1  ai3  . 


j  -  1,2,3,..  ,,N 


f  -Cj  -  d]  *  l  "1  alJ 

i-1 

x.  =  exp  <  - j - 

J  dj 


j  -  1,2,3, ...,N. 


Note  that  for  (5)  to  be  a  solution  of  the  problem, 
we  must  have  all  x^  >  0.  Let  us  thus  assume  that  all 
Xj  >  0.  The  problem  then  reduces  to  that  of  determining 
M  ti.'s  so  that  the  x^  from  (5)  satisfy  (2).  Equivalently, 
the  M  +  N  equations  in  (2)  and  (5)  must  be  satisfied 
simultaneously  by  proper  choice  of  the  N  unknown  x^  and 
the  M  unknown  ” . . 

l 

Since  (5)  is  non-linear,  we  cannot  solve  it  directly, 
but  must  resort  to  approximation  schemes.  We  now  consider 
two  methods  of  approximating  the  solution. 

METHOD  1  (Delta-X  Method) 

Suppose  we  have  an  estimate  of  the  Xj  which  may  or  may 
not  satisfy  (2).  Let  us  denote  the  estimate  by  y ^ .  Then, 
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the  Taylor  expansion  of  log  about  is 

log  Xj  -  log  yj  +  7"  (xj  -  yj>  +  hi-8her  order 


Dropping  the  higher  order  terms,  we  have 


log 


X1  ~  log  yj  +  '  1 


Substituting  (6)  in  (4) ,  we  have 


"CJ  "  dJ 


xi 

log  yj  +  yj  "  1 


M 

V"1  tt  a 

L  1  U 

i«l 


or, 


x<  *  -y< 


log  yj 


CJ + 1  ni  aij 

i=l 


Substituting  (7)  in  (2),  we  have 


M  /  N  a  a  „  \  N  / 

I  I  ■ -bt  -  I‘uMl0ty- 


l- 1  '  j*l 


j-1 


i  «  1  2  3 


terms . 


(6) 


(7) 


M. 
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Letting 


N 


H 


V  “u  *U 

^  a. 


j-l 


we  have 

XrUnt*Si;  1  -  1,  2,  3 . M.  (8) 

1  =  1 

To  solve  the  problem  we  do  the  following:  Solve  (8)  for 

the  M  unknown  tt  and  substitute  in  (7)  to  get  x..  Then 
K  J 

set  -  Xj  and  repeat  the  process.  When  the  change  in 
Xj  becomes  negligible,  we  have  reached  a  solution. 

METHOD  2  (Delta-TT  Method) 

In  this  method  we  assume  that  we  have  an  approxima¬ 
tion  to  the  M  tt^'s.  Substituting  these  into  (5)  we  get 
values  for  x^ .  Now,  rewrite  (2)  as 

N 

8i  -  L  atj  xj  -  bi!  1  ■  !.  2-  3 . M-  <»> 

j-l 

Substituting  the  above  Xj  into  (9),  we  calculate  the  g^. 
g^  *  0,  all  i,  we  have  a  solution. 


If 
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Since,  in  general,  this  will  not  be  the  case,  we  wish 
to  change  so  that  g^ — — 0.  With  this  in  mind,  we  com¬ 
pute, 


Denoting  the  new  values  of  by  tt ^  *  and  =  rt  1  -  rr 
we  may  write 

M 

<>«/-  L  -3rr  «pt.  (11) 

i-1  1 

Now,  approximating  dg^  by  -g^  and  letting 
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we  have 
M 

lrn?imzo  *  ~  i» •  •  •  >m*  (12) 

i=l 


Here  we  have  M  unknown  and  M  equations.  The  algorithm 
then  is  as  follows:  Substitute  the  into  (5)  to  get  Xj . 
Substitute  these  Xj  into  (9)  to  get  g^.  If  these  g^  are 
small,  we  are  done;  otherwise,  compute  and  solve  (12) 
for  P^.  Then  change  to  n^+P^  and  repeat  the  process. 

THE  CHEMICAL  EQUILIBRIUM  PROBLEM 


In  the  chemical  equilibrium  problem  Cl3,  the  variables 
Xj  are  partitioned  into  a  number  of  "compartments."  For 
simplicity,  let  us  say  that  x^,  x ^ ,  ...,  xn^  are.  in  com¬ 
partment  1;  x  +1,  xn^+2 . xn2  are  in  compartment  2, 

•••»  xn  ,+1*  xn  o+2*  xn  are  in  compartment  p,  where 

p-1  p-/  p 

np  -  n. 


Define  x^  -  )  ’  x , ,  so  x^  is  the  sum  of  the  Xj 's 

j-nk-l+1 

in  compartment  k.  Define  Oj  so  that  if  j  is  in  the  k 
compartment,  cfj  ■  x^.  Then  the  chemical  equilibrium 
problem  is  to  minimize 
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n  /  x.  | 

0  «Z  XMCJ  +  108  SjJ  <13> 

j-1 

while  satisfying 

Xj  ■  ■  0;  i  “  1,  2,  3,...m.  (1^0 

j-1 

To  get  (13)  in  the  form  (1),  we  add  p  equations, 
nk 

Xj  -  *  0,  where 

x.  is  now  the  (n+k)c"  variable  and  we  have  a  total  of 
n  +  p  -  N  variables  and  m  +  p  *  M  equations.  Rewriting  (13), 


(15) 
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Thus,  (15)  takes  the  form  (1)  with  dj  *  ±1.  Now  either 
Method  1  or  Method  2  may  be  applied  to  solve  the  prob¬ 
lem.  Method  1  turns  out  to  be  essentially  the  method  used 
by  White,  et  al . ,  [3]  to  solve  the  problem, 

CONVERGENCE 

The  methods  as  given  above  do  not,  in  general,  converge. 
It  is  necessary  that  all  x^  )  0  for  either  of  the  methods 
to  work.  Furthermore,  no  x^  may  get  too  close  to  zero 
enroute  to  the  solution.  At  present,  we  are  conducting 
experiments  with  the  chemical  equilibrium  model  to  find 
ways  of  assuring  convergence.  At  this  point  we  can  only 
indicate  possible  areas  of  difficulty. 

In  Method  2,  if  our  guesses  are  not  good,  the 
computed  by  (12)  may  be  large  enough  so  that  when  the  Xj 
are  computed,  some  Xj  is  smaller  than  the  smallest  number 
available  in  the  computer  and  this  will  cause  that  to 
be  taken  as  zero.  This  may  be  somewhat  alleviated  by  com¬ 
puting  Pmax  *  max  and  then  dividing  by  some  multiple 
of  Pmax*  This  prevents  P^  from  exceeding  some  arbitrary 
value,  and  hence,  prevents  x^  from  going  to  zero. 

In  Method  1,  the  computed  difference  x^  -  y^  may  be 
large  enough  (in  absolute  value)  so  that  some  Xj  becomes 
negative.  Here  again,  we  may  attenuate  the  distance  that 
we  move  in  one  iteration  by  dividing  Xj  -  yj  by  some  number 
that  exceeds  unity.  In  either  case,  there  is  no  assurance 
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that  we  won't  oscillate  around  a  possible  solution.  Our 
experience  thus  far  has  indicated  that  Method  1  may  be 
best  for  starting  the  solution  and  that  Method  2  works 
better  when  we  are  close  to  the  solution. 
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